Sign Language Recognition with Kinect
نویسندگان
چکیده
A framework for general gesture recognition is presented and tested with isolated signs of sign language. Other than common systems for sign language recognition, this framework makes use of Kinect, a depth camera developed by Microsoft and PrimeSense, which features easy extraction of important body parts. Recognition is done using hidden Markov models with a continuous observation density. The framework also o ers an easy way of initializing and training new gestures or signs by performing them several times in front of the camera. Results show a recognition rate of > 97% for eight out of nine signs when they are trained by more than one person.
منابع مشابه
Persian sign language detection based on normalized depth image information
There are many reports of using the Kinect to detect hand and finger gestures after release of device by Microsoft. The depth information is mostly used to separate the hand image in the two-dimension of RGB domain. This paper proposes a method in which the depth information plays a more dominant role. Using a threshold in depth space first the hand template is extracted. Then in 3D domain the ...
متن کاملSign Language Recognition and Translation with Kinect
Sign language (SL) recognition, although has been explored for many years, is still a challenging problem for real practice. The complex background and illumination conditions affect the hand tracking and make the SL recognition very difficult. Fortunately, Kinect is able to provide depth and color data simultaneously, based on which the hand and body action can be tracked more accurate and eas...
متن کاملBuilding an Application for Learning the Finger Alphabet of Swiss German Sign Language through Use of the Kinect
We developed an application for learning the finger alphabet of Swiss German Sign Language. It consists of a user interface and a recognition algorithm including the Kinect sensor. The official Kinect Software Development Kit (SDK) does not recognize fingertips. We extended it with an existing algorithm. Posted at the Zurich Open Repository and Archive, University of Zurich ZORA URL: https://do...
متن کاملSign Language Recognition with the Kinect Sensor Based on Conditional Random Fields
Sign language is a visual language used by deaf people. One difficulty of sign language recognition is that sign instances of vary in both motion and shape in three-dimensional (3D) space. In this research, we use 3D depth information from hand motions, generated from Microsoft's Kinect sensor and apply a hierarchical conditional random field (CRF) that recognizes hand signs from the hand motio...
متن کاملA Novel Occlusion Sign Language Recognition
Sign language plays an important role in communicate with changers that hearing improved. However, the sign language in many countries and areas different and auto recognition system became the research way in recent year. In this paper, we devise a novel method for occlusion processing in Taiwan Sign Language recognition system. Our method employs adxl345 and Kinect to extract the feature of s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011